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Recent recommendations for biology education highlight the role of authentic research experiences early 
in undergraduate education as a means of increasing the number and quality of biology majors. These expe- 
riences will inform students on the nature of science, increase their confidence in doing science, as well as 
foster critical thinking skills, an area that has been lacking despite it being one of the desired outcomes at 
undergraduate institutions and with future employers. With these things in mind, we have developed an in- 
troductory biology laboratory course where students design and execute an authentic microbiology research 
project. Students in this course are assimilated into the community of researchers by engaging in scholarly 
activities such as participating in inquiry, reading scientific literature, and communicating findings in written 
and oral formats. After three iterations of a semester-long laboratory course, we found that students who 
took the course showed a significant increase in their understanding of the nature of authentic research and 
their level of critical thinking skills. 



INTRODUCTION 

Educational studies and assessments have found that 
the engagement and retention of potential Biology majors in 
introductory courses is low and that this is true nationwide; 
the retention of all Science, Technology, Engineering, and 
Mathematics (STEM) majors through graduation is also low 
as fewer than 40% of students who enter college as a STEM 
major graduate with a STEM degree (29). This is likely due 
to academic and social reasons, as many students struggle 
with the transition to college because of increased academic 
rigor and the novelty of independence (30, 39). Higher levels 
of expectation in college compared with high school are 
intimidating, particularly in STEM disciplines that often are 
already perceived as "hard." Additionally, the larger class 
sizes and often dry lecture style of teaching are not condu- 
cive to a good learning environment for first-year students 
(27). Though there have been improvements in the use of 
educational technology to remedy the inherent problems 
associated with large lecture courses, many professors have 
not found the same level of improvement in the thinking and 
learning abilities of their biology students (23). In particular, 
students' critical thinking skills, their abilities to analyze, 
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interpret, and evaluate information; solve problems and 
apply course material to achieve a specific outcome; and 
effectively communicate remain subpar (4, 7, 8, 12). Since the 
development of critical thinking skills and scientific literacy 
produces strong leaders and better prepares students for 
work in the 2 1 st century (8), it is a primary goal of teaching 
that has recently received support from educational recom- 
mendations (I, 24, 40). 

One potential way to accomplish this and improve the 
quality of Biology majors is to involve students in undergradu- 
ate research early in their education. Laboratory courses are 
a natural place to build critical thinking skills because success- 
ful critical thinking instruction requires active engagement of 
students (25). Furthermore, research experience can pro- 
mote better learning of course material (43), improved data 
collection and analytical skills, enhanced scientific reasoning 
and teamwork abilities ( 1 0), and a healthier understanding of 
the nature of science (31). Open-ended investigations allow 
students to learn how science is performed by allowing them 
to do real research projects (17, 37, 44). Students learn more 
when they are given the freedom and opportunity to actively 
discover why and how things are the way they are (5, 33), 
and the earlier students get involved in research, the more 
benefits they will receive (9, 38). 

Inquiry-based learning is the method used to integrate 
scientific inquiry into students' learning, based on the idea of 
"science-as-a-verb" instead of "science-as-a-noun" (3). The 
identified best practices for inquiry-based learning include 
activities that are student-driven and involve students in 
scientifically-oriented questions where they are allowed 
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to formulate hypotheses, make observations, analyze data, 
evaluate explanations from the evidence, and communicate 
their findings and ideas (2, 28). These activities lead to the 
development of the desired critical thinking skills, specifically 
enhancing the ability of students to analyze data, evaluate 
information, formulate hypotheses, solve problems, and 
communicate clearly, all of which fall under the various 
domains of critical thinking (7, 34). Students can gain a 
better understanding of scientific concepts when they are 
involved in the same activities as practicing scientists (3). 
Involvement in these types of exercises improves students' 
attitudes toward science (II, 13, 16, 18) and understanding 
of the scientific process (26). 

A variation of inquiry-based learning is research-based 
inquiry, where inquiry-learning takes the form of an authentic 
research project. Because involvement in this type of course 
can improve critical thinking skills and increase students' 
enthusiasm for science and belief in their ability to perform 
scientific research (19, 21, 22), we created a novel microbiol- 
ogy research-based module that involves second semester 
freshman Biology majors at Purdue University in research 
early in their academic careers, similar to modules that have 
been described recently (5, 6, 1 3, 20). Within this module, we 
provided students with the same laboratory skills they would 
learn in traditional lab classes (pipetting, spectrophotometry, 
use of balance, preparation of dilutions, and basic statistics), 
but within the context of an actual research project. The ob- 
jectives for this module were to increase students' enthusiasm 
for science and research, increase the number of students 
with early research experience, improve their understand- 
ing of the nature of authentic scientific research, improve 
the retention of Biology majors, enable student proficiency 
in scientific understanding and communication, and improve 
critical thinking skills. After implementing this module for 
three years, we have found that students showed significant 
gains in critical thinking skills and demonstrated an increased 
understanding of research and the scientific process. 

METHODS 

Student demographic 

A total of 53 second semester freshmen (36 females 
and 17 males; 39 Caucasians, 3 African-Americans, 6 Asians, 
3 Latino, and 2 classified as other) participated in the 
semester-long laboratory module over the course of three 
semesters. Students from all three semesters were Biology 
majors as indicated by their enrollment in the concurrent 
introductory biology lecture course and second semester 
Chemistry course. All students self-selected into this course 
which met once a week for four hours over the entire 15- 
week semester. Students' reasons for enrolling in the course 
are shown in Table I. Students were asked to provide their 
motivation for enrolling in the class on an informal survey 
administered on the first day of class in all three semesters 
that the course was offered. Two independent reviews of the 



responses were done to establish categories of responses 
and the number of responses that fell into each category. 
There was ^ 80% agreement between the reviewers on the 
coding of the responses. Each student's response was al- 
lowed to fall into more than one category if multiple reasons 
were given. Enrollment in the first semester (Spring 2010) 
was limited to Honors Biology students while the second and 
third semesters of instruction, comprising the bulk of this 
report, were open to both Honors and non-Honors Biology 
majors. Honors students were determined by high school 
GPA and SAT/ ACT standardized test scores per Purdue 
University designations. Initial findings from a longitudinal 
study on the students who enrolled in this class suggest that 
students who chose to take this class in the Spring of 201 1 
had a higher GPA in their science classes before enrolling 
in our class which, in turn, suggests that our self-selecting 
students might not accurately reflect the general student 
population. All student data reported here were collected 
and analyzed in agreement with human studies protocols ap- 
proved by the Purdue University Institutional Review Board. 

Course outline 

The course was designed to be a 1 5-week module divided 
into three sections as indicated in Table 2. Students were pro- 
vided with weekly laboratory manuals containing applicable 
background information and the specific laboratory protocol 
for the experiment(s) of that week. When procedures were 
repeated in later weeks, the students referred back to the 
manuals and their notes to complete the procedures. 

During the first portion of the semester, students de- 
veloped the skills and concepts required to understand and 
proceed into the research portion of the course as well as 
the basic lab skills normally taught in an introductory lab 
module. Techniques were demonstrated to the students 
as they were relevant to the lab activities and research 
project and students would then copy and practice them. 
After acquiring background skills such as proper use of 
micropipettors, aseptic technique, spread plating, quadrant 
streaking, and spectrophotometry during the first portion of 
the course, students worked in teams to devise a hypothesis 
and design a mutagenic scheme to produce mutations in 
the pro? gene of Salmonella typhimurium. They were given 
the option to use different mutagenic conditions so long 
as they used a strain capable of genetic mapping with the 
established technique. After designing a scheme, students 
generated mutants that were able to grow in the presence 
of high concentrations of glycine betaine and used classical 
genetic techniques to map which mutations were linked to 
proP. In order to identify the location of the mutation, stu- 
dents PCR amplified pro? and sequenced the gene. 

Student assessment within the course/module 

Assessment of student performance was completed 
through a mix of group and individual assignments in the 
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TABLE 1. 






Student motivation for enrolling in 


research-based module. 


Reason a Number (Percentage) of Student Responses 


Cni>inn ">fi 1 A / n - 1 C\ 

spring L\3 I u {n — to) 




spring zu II (n — i o ) spring zu I z yet — \y) 


Kesearcn experience 4/ 1 d (zo/b) 




c/ 1 O /"3QO/\ 1 1 / 1 Q /CQ°/\ 
Dl I J [jy/o) 11/17 [po/o) 


Sounded interesting 3/15(20%) 




1/13 (8%) 2/19(10.5%) 


Improve lab skills 3/15(20%) 




2/13 (15%) 3/19(16%) 


Major requirement 1/15 (7%) 




2/13 (15%) 1/19(5%) 


Better than alternative 3/ 1 5 (20%) 




2/13 (15%) 2/19(10.5%) 


Other 1/15(7%) 




1/13(8%) 


a Student motivations obtained from beginning semester surveys. All student responses were classified into the six categories shown on 


the chart. If a student response fell into multiple categories, the response was included in the score for both categories. A "-" indicates 


that no students gave a response that fit that particular category. 






TABLE 2. 






Outline of activities and desired outcomes over the 15-week semester. 


Weeks Activities 




Desired Outcomes 


1-3 • Learn basic laboratory techniques 


1. 


Demonstrate proficiency with bacterial cultures. 


• Learn and practice the scientific method 


z. 


Describe proP transport system. 


• Learn requirements for growth and 


3. 


Apply hypothesis-driven inquiry. 


maintenance of pure cultures 


4. 


Practice accurate note-taking. 


• Learn basic genetics 






• Learn how to keep a laboratory notebook 






4-5 • Perform mutagenesis/select mutants 


1. 


Demonstrate ability to select mutants. 


• Paper Discussion #/ (Mutations and osmotic regulation) 


2. 


Summarize points from review articles. 


• Lab Report #1 


3. 


Write lab report in scientific paper format. 


6-11 • Learn transduction technique and genetic linkage 


1. 


Apply mutation mapping and selection techniques. 


• Lab Report #2 


2. 


Describe transduction as molecular biology tool. 


• Paper Discussion #2 (student-selected) 


3. 


Demonstrate ability to read and discuss primary literature 






articles. 


12-13 • PCR and gel electrophoresis 


1. 


Amplify and sequence proP with PCR. 


• Identify mutations 


2. 


Demonstrate ability to run an agarose gel. 


• Lab Report #3 


3. 


Utilize online bioinformatic tools. 


• Paper Discussion #3 






14-15 • Informal PowerPoint presentation on preliminary data 


1. 


Summarize and interpret a large data set. 


• Poster preparation and presentation 


2. 


Demonstrate effective oral communication of results. 




3. 


Explain the difference in format between research papers 






and posters. 




4. 


Construct a clear poster for public presentation. 




5. 


Communicate data with scientific community. 


form of standard classroom evaluations and assignments based on their responses to online personality and learning 


related to the research projects (see below). Students were styles 


inventories, the Myers-Briggs type indicator (http:// 


grouped into teams of two or three on the first day of class www.humanmetrics.com/cgi-win/jtypes2.asp) and the VARK 
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questionnaire (http://www.vark-learn.com/english/index. 
asp). Each group was composed of students with differing 
personalities and learning styles as well as a mix of males and 
females, when possible. Students worked with their groups 
to complete the research project and select class assign- 
ments throughout the semester. Peer- and self-evaluations 
were completed by all the students three times during the 
semester to allow them to reflect on their performance 
and that of their teammates in their group work. Students 
assigned themselves and their group member(s) a score 
from I to 4 (I = Poor and 4 = Excellent) in three categories: 
preparation, technical proficiency, and teamwork. The re- 
views for each student were totaled and averaged and each 
team was provided with feedback from the instructor based 
on the responses to facilitate good team work. 

All group assessments were modeled after activities that 
are common practice for research scientists and consisted 
of an independent experimental proposal modeled after a 
scholarly grant proposal, a brief PowerPoint presentation 
of preliminary findings presented to the class, and a sci- 
entific poster designed and formally presented to faculty 
and graduate students of Purdue University. Individual as- 
sessments consisted of standard lab course assignments, 
including weekly quizzes on background information and 
weekly participation in lab activities, as well as activities 
that are common practice for research scientists. These 
included three guided discussions of primary and secondary 
research literature, three lab reports written in scientific 
paper format, and a weekly check of laboratory notebook 
maintenance (notekeeping and reflection). 

Peer Led Team Learning workshops (PLTL) 

Students in the class during the 201 1 and 2012 offer- 
ings were divided into small groups (four to six students/ 
group) that met with a peer leader for five to six workshops 
during the semester. The material explored in the work- 
shops complemented and extended concepts and activities 
covered in the course. The topics were: I) how to keep 
a laboratory notebook, 2) data analysis and evaluation, 3) 
how to write a scientific paper, 4) how to read a research 
article, 5) ethical conduct in science, and 6) how to make 
a research poster. The peer leaders were Biology majors 
who had taken the class the previous semester and were 
chosen based on their interest in the position, performance 
in the class, and ability to work well as leaders in a group 
based on observations by the instructors. The students 
were required to read a brief document(s) and occasionally 
answer a few questions prior to each workshop. Students 
worked on guided-activities in pairs and as a whole group 
during the workshops. These workshops were required 
but not graded to give the students a setting in which to 
work on the material without a grade. The peer leaders 
kept electronic journals and reported that participation 
was high. The workshops were all adapted from work- 
shops designed and implemented in research-based lab 



classes in the chemistry department (Varma-Nelson et 
al., unpublished data). 

Student feedback 

Student interest in and satisfaction with the course 
were determined by anonymous end-of-semester online 
course evaluations, a postsemester focus group interview 
(Spring 2010), and an attitudinal survey administered using 
an online survey tool (Qualtrics Labs Inc., Provo, UT) issued 
pre- and postsemester to students enrolled in the spring 
of 201 1 and 2012. The first installment of the module in the 
spring of 20 1 0 was evaluated by participation of all students 
in a focus group session held by an assessment coordinator 
at the Discovery Learning and Research Center (DLRC) at 
Purdue University. This session was held after the formal 
poster presentation and focused on four evaluative ques- 
tions: I) What benefits accrued to participants from their 
participation in the module? 2) What are the impacts of 
the module on students' research and laboratory skills and 
understanding of research publications? 3) What are the 
impacts of the module on students' educational and career 
aspirations, especially aspirations for research-oriented 
careers in the biology field? 4) What are the challenges 
associated with participation in the module and what are 
participants' suggestions for improvement? 

The attitudinal survey used in the spring of 2011 
and 2012 was a 37-item, 6-position Likert-type survey devel- 
oped for use within the chemistry CASPiE classes (41, 42). 
The survey prompted the students to rate their agreement 
with the 37 items reflected on their most recent laboratory 
course in biology. Presemester responses therefore reflect 
their feelings about their high school biology laboratory ex- 
perience and postsemester responses reflect the laboratory 
module. An external evaluator for the chemistry CASPiE 
program found that the pretest responses to 26 of the items 
reduced into five factors (32): I) Interest in Chemistry/Sci- 
ence, 2) Perceived connection between real life and science, 
3) Lab perceived as similar to real scientific lab practices, 4) 
Perceived learning of chemistry content through laboratory 
(self-assessment), 5) Belief that they can understand and do 
scientific research (self-efficacy). The Cronbach's a was > 
0.800 for all five factors. A total of 26 of our biology stu- 
dents from the spring of 201 1 and 2012 responded to both 
the pre- and postsemester attitudinal surveys indicating their 
level of agreement with statements probing various aspects 
of their interest and confidence in science and research. 
Our sample size of matched pairs was too small to perform 
exploratory factor analysis to determine the validity of the 
survey and previously identified factors in our population of 
biology students. Therefore, we determined the Cronbach's 
a for each of the previously defined factors in our pre- and 
postsemester data to evaluate the reliability of the survey 
items in measuring the factors. We found Cronbach's a > 
0.700 for all five factors suggesting that the items making up 
the factors identified previously were reliable for our context 
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(Appendix I). A one-way AN OVA with Bonferroni correction 
for multiple comparisons was used to compare the pre- and 
postsemester surveys using SPSS statistical software. 

Critical thinking 

We utilized the Critical thinking Assessment Test 
(CAT) developed by Tennessee Technological University 
(34-36) to evaluate the development of critical thinking 
skills in students from the Spring of 20 1 1 and 20 12. The CAT 
instrument was administered in a pre-/postsemester design 
during regular class time in accordance with an approved 
protocol for human studies. The pretest was taken by all 
students enrolled in the class in the second week of the 
semester and the posttest was administered in week 14 of 
the semester. Students were given one hour to complete the 
test but they were free to take longer, if desired. The tests 
for 20 1 1 were scored by Tennessee Tech University and the 
tests for 2012 were scored on-site at Purdue in a session 
led by faculty who had been given official training for scor- 
ing the instrument (http://www.tntech.edu/cat/training/). 
Tests scored at Purdue were returned to Tennessee Tech 
University for accuracy checking and final-score summaries. 
The pretest scores were not significantly different between 
2011 and 2012 semesters (two-sample t-test) so the data 
were lumped. Differences between pre- and postsemester 
scores were statistically analyzed with a one-way ANOVA 
with Bonferroni correction for multiple comparisons. 

RESULTS 

Student assessment of research-based module 

Students' motivation for enrolling in the course re- 
mained relatively constant over the three semesters (Table 
I), though there was a steady increase in the proportion of 
students taking the course because they were interested 
in obtaining research experience. As part of the standard 
Purdue course evaluations, students were urged to submit 
written comments pertaining to what they liked about the 
course or what they disliked with suggestions for improve- 
ment. Many students wrote comments reflecting how much 
they learned and how they believed they gained a lot from 
the research-based activities and teaching methods used. 
The most common complaint students had dealt with the 
workload of the course. Students felt the amount of work 
required was higher than the two credits awarded for com- 
pletion of the course. Comments are shown in Appendix 2. 

After the first semester of this research-based lab 
course was taught, we wanted to gain more information on 
students' real feelings about the course and how it helped 
improve their interest in science and understanding of the 
nature of scientific research. To accomplish that, we needed 
an assessment that went into more detail than the standard 
Purdue student course evaluations. A focus group session 
with four preselected evaluative questions was led by an 



assessment coordinator of the DLRC at Purdue. These 
questions and the results from the focus group session with 
selected student quotations are shown in Table 3. Much 
like the course evaluations, the focus group survey results 
show students appreciated the course. Even the minority 
of students who indicated they did not wish to continue on 
to graduate school felt they learned a lot and had increased 
interest in taking upper level biology courses. 

Students from the second and third installment of the 
course voluntarily took an anonymous attitudinal survey 
in a pre- and post- fashion with some prompts that were 
analogous to the focus group session questions. The students 
indicated their level of agreement with statements probing 
their experience in five areas: I) Interest in biology/science, 
2) Perceived connection between real life and science, 3) 
Lab perceived as similar to real scientific lab practices, 4) 
Perceived learning of biology content through laboratory 
(self-assessment), 5) Belief that they can understand and do 
scientific research (self-efficacy). Presemester responses 
indicate students' opinions of their high school biology lab 
experience while postsemester responses reveal students' 
feelings toward the laboratory module. Figure I shows 
select pre- and postsemester results from the attitudinal 
survey. An increased number of students agreed they had a 
better understanding of the process of scientific research, 
that lab experiences were very similar to real research, 
and that lab experiences increased their appreciation for 
the role of scientists in society postsemester compared 
to presemester. These results were statistically significant 
(Appendix 3). There was a trend toward increased interest 
in the process of science in the postsemester, though the 
data were not significant (Appendix 3). Mixed results were 
seen for the number of students interested in earning a PhD 
in a scientific field. More students felt strongly interested 
in earning a PhD postsemester, but more students also felt 
strongly disinterested in earning the degree postsemester. 
When asked about their confidence in explaining a biology 
experiment from the course to an instructor, students 
showed little increase postsemester; however, students 
were already confident in their ability to accomplish this at 
the beginning of the semester. 

Critical thinking Assessment Test 

One of the objectives we had for this class was to 
develop students' critical thinking skills. As has been noted 
by many educators and postgraduate employers, a lot of 
emphasis is placed on developing students' critical thinking 
skills during their undergraduate careers. However, the ac- 
tual teaching of them in undergraduate courses is lacking (4, 
12). To determine how well the activities in this course led to 
increased critical thinking skills, students in the second and 
third installments of the course took the CAT (Critical think- 
ing Assessment Test) in a pre-/postsemester format. The 
CAT instrument divides critical thinking into four domains 
that encompass previously defined domains (7, 8): problem 
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TABLE 3. 

Student responses to evaluative questions asked during focus group session. 



Evaluative Question 



Student Data 



Select Student Quotations 



What benefits accrued 
to participants from 
their participation in the 
research-based module? 



What are the impacts of 
the module on students' 
research and laboratory 
skills and understanding 
of research publications? 



What are the effects of 
the module on students' 
educational and career 
aspirations, especially 
aspirations for research- 
oriented careers in 
biology fields? 

What are the challenges 
associated with participa- 
tion in the module and 
what are participants' 
suggestions for 
improvement? 



All felt the module was a positive learning 
experience. 

A majority described the module as in- 
tense, rewarding, illuminating, informative, 
or helpful. 

All indicated the module increased their 
interest in taking higher-level classes in 
biology. 



Students felt that they successfully: 
acquired basic/technical laboratory skills, 
enhanced research skills and communica- 
tion of research findings, 
enhanced understanding and interpretation 
of scholarly publications. 



Some students' career plans were im- 
pacted by the course, others were not. 
A majority indicated they would like to go 
to graduate school. 



Students thought the module would be too 
intense and time-consuming. 
Students felt the module was too much 
work for the amount of credits. 



I thought it was really nice because we got to learn 
some of the basic laboratory techniques that we are 
going to need in the future, like pipetting and aseptic 
technique and things like that, but at the same time 
we were working on research that hadn't been done 
before and contributing to furthering knowledge. 
It's not research just for the sake of research, or ex- 
periments for the sake of experiments. We actually 
did the experiments with a research goal in mind. 

Being able to read papers and really get into the lit- 
erature and then write your own papers that basically 
sound like those papers. When at first you start read- 
ing them and you think every other word is a foreign 
word . . . but now that we have done the poster session, 
we said. ..those words, and . . . gaining that familiarity 
with a foreign language was really cool for me. 
The process of writing lab reports . . . was also good 
practice, because it helped in understanding reading 
other people's research papers. 
The figures and graphs really developed throughout 
our lab reports. 

I think just the fact that it's research can tell you 
whether or not you'd like to do research in the long run. 
I know I'm actually planning on also doing a major in 
micro thanks to this class, so I probably wouldn't have, 
so I found it to be really interesting. 



The only negative thing I can think of, as far as expecta- 
tions, is it was only a two-credit hour course and was 
like a lot of time. 

This is probably one of my most work-intensive classes. 
It definitely took the most time out of all my classes. 



solving, creative thinking, evaluating information, and effec- 
tive communication. Figure 2 shows the comparison of pre- 
and post- test scores from students taking the CAT test in 
our classes. Students showed a significant increase in their 
total postsemester CAT scores compared to presemester (p 
< 0.05, one-way AN OVA with Bonferroni corrected alpha). 
When broken down into specific questions, students also 
demonstrated a significant increase in their scores for two 
questions, one probing the ability of students to evaluate 
information and the other probing two domains — creative 
thinking and effective communication. 

DISCUSSION 

The goals of our research-based module were to: 
increase students' enthusiasm for science and research, 



increase the number of students with early research experi- 
ence, improve their understanding of the nature of authentic 
scientific research, improve the retention of Biology majors, 
enable student proficiency in scientific understanding and 
communication, and improve critical thinking skills. 

Student assessment of research-based lab module 

The feedback has shown that students generally have 
a positive view of the course. Given that these are first- 
year students who are actively designing and executing an 
authentic research project that would be performed in a 
real scientific laboratory, it is not unexpected that the class 
would be perceived as difficult and the workload significant. 
The majority of students felt that while this was the case, 
the benefits of the course made the effort worthwhile. 
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The lab experience made me more 
" interested in science 

20 



15 
10 



5 - 



■ I 




The lab experience made me more 
B interested in earning a Doctoral degree 
(Ph.D.) in a science field 



2 - 




□ pre 
■ post 



3 4 5 6 



20 



c 
o 

Q- 



^ 10 



E 



I gained a better understanding of 
the process of scientific research 



15 - 



n n n. 



1 



D 

15 
10 



The lab experiences were very 
similar to real research 



1 2 3 4 5 6 



1 2 3 4 5 6 



scientists in society 



The lab experimentslncreased my 
^ appreciationforthe role of 

20 

15 

10 

0 



XL 




F 

20 
15 
10 

5 - 



0 



I believe I could accurately explain a 
biology experiment from the course 
(including the significance of the 
results) to my instructors 



1 



1 2 3 4 5 6 1 2 3 4 5 6 

Likert scale value 

FIGURE I. Comparison of student responses to select questions from a pre-/postsemester attitudinal survey. The number of student 
responses to select questions from a Likert scale attitudinal survey where 6 = Strongly Agree, 5 = Agree, 4 = Barely Agree, 3 = Barely 
Disagree, 2 = Disagree, and I = Strongly Disagree. 



On the informal survey issued on the first day of class, the 
majority of students (40/45) indicated that they were inter- 
ested in attending some form of graduate studies (graduate 
school, medical school, veterinary school, dental school, 
or a combination). Over half of those 40 students (22/40) 
expressed an interest in graduate school. While encourag- 
ing, convincing students to pursue research careers is not 
a goal of the course and given that students self-select into 
the research-based course, we recognize there may be a 
bias toward the enrollment of students already committed 
to graduate school. Previous studies suggest that students' 
preexisting interests are not often shifted by research 
class experience (38). We wanted to expose students to 
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an original research experience early in their education to 
increase their interest in science and knowledge of how real 
scientific experimentation works. All scientists know that 
research is not for everyone, and it is better for students 
to learn whether they enjoy research earlier rather than 
later. Concerns over whether student interest in the course 
would be affected by disinterest in the specific research 
topic are not justified. Comments from the focus group 
indicate even those students who were not interested in 
the microbiology research project still felt that the fact that 
it was research made the course worthwhile and provided 
them with valuable lab skills that have prepared them well 
for future biology courses (data not shown). 
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CAT pre/post 




pre 



post 



FIGURE 2. Comparison of student pre- and postsemester CAT 
scores. The average total CAT scores for pre- and postsemester 
tests taken by students enrolled in the spring of 201 1 and 2012. 
N = 37 pre- and posttest scores. Error bars are the standard 
deviation. *p < 0.05, one-way ANOVA with Bonferroni cor- 
rected alpha. 

Evaluation of student attitudes after participating 
in the module 

We observed significant gains in students' understanding 
of the nature of scientific research based on responses to all 
prompts that contributed to that factor on the attitudinal 
survey, which was one of our objectives for this project. 
However, we did not observe significant gains in student re- 
sponses to prompts regarding the other four themes targeted 
by the survey. Student interest in biology and science did not 
significantly change. This could be due to a variety of reasons 
including: not being interested in research, the specific topic 
of the class, or the realization of what science and scientific 
research really are. Alternatively, it is also possible the self- 
selecting students already had a high interest in science prior 
to the start of the semester as noted earlier; these students 
are already planning to be Biology majors. The slight negative 
trend in the theme of perceiving a connection between real 
life and science suggests to us that we need to target that 
area of our instruction and activities as it is important for a 
scientifically-literate society to see connections with what 
they know and the world of science and research. 

We did administer our attitudinal survey to students 
participating in the traditional lab class, but the number of 
matched pairs for pre- and postsemester surveys was too 
small for a valid analysis of the data. However, data gathered 
from the other research-based class taught in the fall (13) 
indicate that there are significant differences in the postse- 
mester (data not shown). 

Critical thinking Assessment Test 

We saw a significant gain in student critical thinking as 
measured by the CAT instrument (Fig. 2). Students were 
engaged in all four critical thinking domains probed by the 



CAT instrument in all blocks of the semester (Table 2). The 
practice of critical thinking skills was implicit in many of the 
activities and assignments that students completed during 
our course and in the PLTL workshops (Table 2). The skills 
and strategies learned from the explicit instruction and guid- 
ance were expected to be employed in assignments such as 
lab reports and the research poster. Students use critical 
thinking skills in the discussion section of lab reports in 
evaluating and interpreting data as well as thinking creatively 
to think of the next steps in their projects. We have begun 
more carefully analyzing the discussion sections of the lab 
reports over the course of the semester (Spring 2012) to 
identify areas of gains and areas where targeted instructional 
interventions would be helpful. 

Upon reflection of our instructional approaches with 
respect to critical thinking skills development, the majority 
of our activities and assessments are embedded. There is 
evidence of higher gains in critical thinking with the use of 
explicit instruction with practice (25). We intend to devise 
more explicit instruction on how to solve problems, such 
as providing students with step-wise strategies and practice 
for evaluating information and data. These approaches will 
hopefully become tools that students will internalize and 
transfer to subsequent classes and situations. 

Obviously students were enrolled in other classes which 
could contribute to the gains we observed. Our efforts to 
recruit a comparison group have been unsuccessful and we 
are revising our human studies protocols to offer a more 
enticing compensation for participation. However, given the 
activities and feedback that the students received, it is likely 
that at least some of the gains are due to activities in our 
class. Significant gains on the CAT have not been observed 
in a single semester unless there are focused instructions 
that would foster critical thinking development (Barry Stein, 
personal communication). 

CONCLUSION 

Early research experiences are beneficial to students 
in a number of ways (21, 22). We are currently evaluating 
the long-term impact of introductory lab classes by follow- 
ing students who have enrolled in these classes as well as 
students who did not throughout their time at Purdue. We 
are tracking students' choice of major, persistence in science, 
participation in other research experiences, and academic 
performance at Purdue. 

From the perspective of the instructors and research- 
ers, this class has also been a tremendous success. While 
this type of course requires more instructional time and 
management than cookbook lab classes, the benefits far 
outweigh the costs. This course was recognized for its 
educational merit and was one of the 2012 AAAS/Science 
Prize winners for Inquiry-Based Instruction (15). Further, 
the data generated by the students in the 2010 and 2011 
spring semesters led to a scientific publication with all of 
the students as authors (14)! 
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Involving introductory biology students in authentic re- 
search experiences in their classes is one of the recommen- 
dations for improving biology education for undergraduate 
students (I). With our class we have demonstrated that this 
model can be successful and that a genetic screen provides 
a feasible project for first-year students to engage in. This 
class has generated research-quality data, improved critical 
thinking skills, increased student understanding of the nature 
of scientific research, and engaged and excited students. 

SUPPLEMENTAL MATERIALS 

Appendix I: Confirmatory factor analysis for attitudinal 
survey 

Appendix 2: Representative quotes from written com- 
ments section of Purdue course evaluations 
Appendix 3: Pre-/Postsemester changes in attitudes 
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